ON MAXIMAL CONSERVATIVE EXTENSIONS 



HENRY TOWSNER 

Abstract. We investigate the set of n3> sentences which are III con- 
servative over the theories of reverse mathematics RCA + JE n and 
ACAo. We exhibit new elements of these sets and conclude that the 
sets are II2 complete. 



1. Introduction 

Many questions in reverse mathematics amount to asking about the im- 
plications among Ilr, sentences over a fixed background theory. One aspect 
of calibrating the strength of these II2 sentences is asking what their first- 
order — that is, arithmetic — consequences are, and so a natural goal is to 
identify, for a given li^ sentence, what arithmetic sentences are needed to 
capture its arithmetic consequences. Phrased differently, we ask what II \ 
theory T is needed so that the sentence is Il}-conservative over T. 

Yokoyama [§] and, independently, Ikeda and Tsuboi Q, showed that when 
T is a II2 theory, there is a maximal H\ theory nj;-MAX(T) which is IlJ 
conservative over T. In the particular case where T is RCAo, three (families 
of) members of IlJ-MAX(RCAo) are known: weak Konig's lemma (due to 
Harrington) , a version of the Baire Category Theorem 0] , and the existence 
of cohesive sets Yokoyama asked whether these statements provided 
axioms for nJ-MAX(RCA ). 

In this paper we exhibit new elements of the theories ilJ-MAX(RCAo + 
JS n ) and IT^-MAX(ACAo) which suffice to show that these theories are II2 
complete. In particular, this means the theories are not given by a finite 
number of axiom schemes. 

2. Definitions 

Throughout this paper, we consider theories in the language C? of second- 
order arithmetic; all theories we consider will extend the standard base 
theory RCAo (see [8]). All models will have the form 9K = (M,A4) where 
M is a model of first-order arithmetic and M C P(|Af|). (As the example 
suggests, we will write the Fraktur letter 9Jt for the model, the Roman letter 
M for the first-order part, and the calligraphic letter M for the second-order 
part.) We write \M\ for the universe of M and ||M|| for the cardinality of 
\M\. 
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Definition 2.1. We say Wl is countable if ||M|| = \M\ = Hq. We say Wl is 
an uj-submodel of 2T? if M = M' and .M C M' . 

We follow the convention of using lower case letters to refer to elements 
of \M\ or numeric variables, and upper case letters for elements of A4 or 
set variables. In particular, when we write Vx4>, we mean x is a numeric 
variable, while \/X(j> indicates that X is a set variable. 

Definition 2.2. Let TCT'be theories in C 2 . We say X" is 11} conservative 
over T if whenever T'ht; and u is a 11} sentence, already T h a. 

We say a sentence a is true if (N,7- > (N)) \= a. A theory T is true if every 
sentence in T is true. 

The most common way to show that some theory is 11} conservative is to 
show that it has the w-extension property: 

Lemma 2.3. Suppose that every countable model ofT is an uj-submodel of 
a model of T' . Then T' is II} conservative over T. 

Cholak, Jockusch, and Slaman asked if, for II2 theories, this is the only 
way for a theory to be IT} conservative [5(]. That is: 

Question 2.4. Suppose T QT' are IT?, theories extending RCAo, and that 
T' is a n} conservative extension of T$ . Is it the case that every model of T 
is an oj-submodel of a model of T' ? 

Avigad showed that the answer is no [l| ; this was extended by Yokoyama 
, who showed that the answer is still no even if we require that T" be true. 
We will provide some additional examples below. 

However Yokoyama |9(] and Ikeda and Tsuboi [7] showed that, nonetheless, 
two distinct II?,, 11} conservative extensions of T do have common models. 
More precisely: 

Theorem 2.5. Let Tq,T\,T2 be II}, theories such that T\ and T2 are LT} 

conservative extensions ofT$. Then T\ +T2 is a 11} conservative extension 
of T . 

By standard compactness arguments, if To C T\ C • • • and each Tj is 11} 
conservative over To, so is IJjTj. 

Definition 2.6. n}-MAX(T) is the collection of Ii\ sentences a such that 
T + a is 11} conservative over T. 

Corollary 2.7. If T is a II^ theory then LT}-MAX(T) is 11} conservative 
over T. 

3. Sets at Arm's Length 

We work with some fixed internal bijective pairing function, (•, •) : \M\ 2 — > 
\M\. For longer tuples we write (. . . ,y, z) as an abbreviation for ((..., y), z). 
When functions are understood to take tuples as their input, we will write 
f(x, y,...,z) instead of f((x, y, . . . , z)). 
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Definition 3.1. If X G S, we say X is convergent if for each i G \M\ there 
is an m G \M\ such that for all m' > m, (i,m') G X iff (i,m) G X. If X is 
convergent, we write 

limX = {i | 9Jt t= 3mVm' > m (i, m ) G X} = {i | SOT 1= \/m3m' > m (i, m!) G 

We define n-convergence and lim n X recursively. Every X is O-convergent 
and lim° X = X. If X is n-convergent, we say X is n + 1-convergent if 
lim ri X is convergent, and define lim n+1 X = limlim™ X. 

Of particular importance is the fact that if X G Ai, the set lim n X is 
A n+ i in Wl using X as a parameter. 

To actually build models, it is convenient to use the following standard 
result: 

Theorem 3.2 (Friedman [6]). If SOT is a model of JS n then it is an oj- 
submodel of a model of RCAo + /S n . 

Our main tool for proving results about n}-MAX(RCA + IS n ) is the 
following theorem: 

Theorem 3.3. Let Wl = (M,M) be a countable model o/ RCA + IE n , 
and let S C \M\. Then 9Jt is an uj-submodel of some 9JI' = (M,A4') such 
that Wl' \= RCA + I^n and there is some X G M' with lim n X = S. 

In other words, while we cannot expect to add arbitrary sets to a non- 
standard model (since such a set could easily violate induction) , we can add 
descriptions of arbitrary sets as long as we "keep them at arm's length" — as 
long as the set is described only as a limit which is too complicated to be 
covered by the induction axioms in the underlying theory. 

3.1. The /Si Case. We first prove the case where n = 1 to illustrate the 
method. The main tool is a forcing argument based on the technique from 

i 

Theorem 3.4. LetWl = [M,M) be a countable model o/RCAo+JSi, and 
let S C \M\. Then 9Jt is an uj-submodel of some 9Jt' = (M, M') such that 
ffl \= RCA + JEi and there is some X G M* with \\mX = S. 

Proof. By Theorem 13.21 it suffices to show that there is an S such that 
limS = W and for every Si formula (j)(x,X) with parameters from 50?, 
induction holds for cp(x, S). 

We prove this by forcing. Our conditions will be tuples p = (x p ,I p ,V p ) 
where: 

• Xs is a {0) l}-valued function with bounded domain whose graph is 
in M, 

• I p is finite, 

• V p : I p -)■ \M\, 

• Whenever i G I p , there is an s > V p (i) such that x p {h s ) is defined, 
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• If i G I p , s,s' > V p (i) and X p (h s ) and X p (h s ') are both defined 
then = X P (M')- 

We define v v to be the partial function such that: 

• X p C ^, 

• If i € 7 P and s > V p (i) then z/ p (i, s) = x p (h s') where s' > V p (i) is 
such that x p (h s ') i s defined. 

We say p' r< P if X P B Q X P B , I p Q I p \ and V p> \I P = V p . Note that this 
implies / C / . We write p' P if p' ^ P and I p = I p . 

X p is an approximation to the characteristic function of the set X we 
ultimately built. I p is a collection of points where we have fixed the value 
of the limit, and V p is the point by which the limit has converged. 

We consider formulas in the language C 2 (G), given by expanding C? with 
a fresh set constant G and constants for all parameters from Wt. It is con- 
venient to restrict consideration to prenex formulas. 

If (j> is a Ao formula in C 2 (G), we say p lh 4>(G) if for every S such that 
Xs \ dom(u p ) = u p , 4>(S) holds. We say p lh 3xcf)(x,G) if whenever p' ^ p, 
there is some p" ^ p' and some m € \M\ such that p" lh (p(m,G). We say 
p lh Vx0(a;,X) if for every m € |M|, p' lh (f>{m). Note that when is Ao, 
p lh 4> is a Ai statement. 

We will construct an infinite sequence of conditions po >z pi >: • • ■ satisfy- 
ing the following properties: 

• If pj lh 3x(j)(x) where (j> is Ao then there is a j' € N and a fc G |M| 
such that pj/ lh (/>(fc), 

• For each Si formula 4>{x) in C 2 (G), either there is a j such that 
Pj lh Vx-k/)(x) or there is a j and a c G |M| such that pj lh 0(c) A Vx < 
c -i</>(x) 

• For each z G |M|, there is some j with i G I Pj and x P3 {h V P:i {i)) = 
Xw{i)- 

We may break each of these properties up into countably many requirements. 
In most forcing arguments, we would show that the sequence satisfies all 
these properties by showing that each requirement is satisfied by a dense set 
of conditions. In order to avoid conflicts with the third property, however, 
we need slightly more: we need to show that the first two properties are 
dense with respect to and only in order to satisfy the third property will 
we add elements to I p . 

The first set of requirements is easily handled: if p lh 3xcj)(x) then there 
is a q ■< p and a k such that q lh (f>(k). Since forcing a Ao statement is 
Ai, this depends on only boundedly many values of v q , so we may choose a 
q' P so that x q agrees with u q on a large enough bounded subset so that 
q' lh <f>(k). 

To satisfy the second family of requirements, let a condition p and some 
Si formula 3ycp(x, y) be given. Consider the set of c such that there is some 
Q P and some m such that q lh </>(c, m). If there is no such c then we have 
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p lh \/xVy-xj)(x,y), and we are finished. Otherwise, the set of such c is a Si 
set, so (since the ground model satisfies /Si) there is a least such c, and so 
we may pass to some q P so that q lh 3y(p(c,y). It suffices to show that 
if d < c, q h \fy^(f)(c/ ,y); suppose not, so there is some d < c, some q' ■< q, 
and some m such that q' lh (j)(d,m). Then, since forcing a Ao formula is 
a Ai property, again there is a bounded portion of v q witnessing this, and 
therefore there is a go ^oP so that qo lh 4>(d,m). But this contradicts the 
leastness of c. 

The third set of requirements is satisfied by setting I q = T p U {i}, setting 
V q (i) to be larger than any element s with x p (i,s) defined, and setting 

X q (i,V q (i))= X w(i). 

We take X = {x \ 3i v Pi (x)=l}. We have that whenever pi lh <p(G) 
where (fi(G) is IIi or Si, <p(X) holds: when eft is Ao or II i this is immediate 
from the definition, and for Si formulas this is enforced by the first set 
of requirements. The second set of requirements ensures that Si induction 
holds for formulas including X as a parameter. The third set of requirements 
ensures that limX = W. □ 

3.2. The General Case. We now turn to the full proof of Theorem 13.31 
Throughout this argument, we work with a fixed value re. To manage no- 
tation, we introduce the following shorthand: we write sLji for the finite 
sequence s n , • • • , Sj. In particular, instead of writing f(s n , • • • , Si), we will 
write /(s[„,i]). 

Our forcing conditions will be tuples 

P=(X P ,{l!h<n,{Vf}i<n) 

where: 

• x p is a {0) l}-valued function with bounded domain whose graph is 
in M, 

• In is a finite set, 

• For each i with < i < n, If is a bounded set of sequences of length 
re — i + 1 which is in A4, 

• For each i with < i < n, Vf : If — > \M\ is a function in A4, 

• (Realization) If 1 < i < re and St ni i G J? then there is some Sj_i > 

[n,i]) so that S[ ni j__i] € 

• (Realization) If sui] G I p then there is some sq > ^(sLii) so that 
X p (s[n,o}) is defined, 

• (Coherence) If m < re, X p (s[n,m+i], *jm,o]) and X p (s[„, m+ i], t| m 0] ) are 
both defined, and for every i G [0,m], (s*[ n ,m+i] , t[m,i+l] ) e 4+i> *t ^ 

^+l(s*[n,m+l]' *[m,i+l])' and (*[n,m+l] ' *[m,i+l]) £ 4+1' *i - ^i+l(*[n,m+l] > *[ m) i+l])> 
then 

X P (s*[n,m+l]^[m,0]) = X P (s[n,m+l] ? *[m,0] )• 

We say g ^ p if: 
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• For each i with < i < n, If C J? and C 1/^. 

The only reason that that 1% has to be handled separately from If for 
i < n is that is required to be actually finite, while If is merely 9Jt-nnite. 

The coherence property requires some unpacking to understand. We start 
with If: we intend for X to be convergent, which means that for each s, 
there should be some v such that xs(s, m) is the same for all m > v. When 
s = *[n,i] € j this means we have decided that u = Vl(s[ n ^). Similarly, 
when n = 2, we also need limS" to be convergent, which means that for each 
s there should be some Si so that when t\ > s\, (lim S)(s, t\) is the same 
for all t\ > si, which in turn means that lim rn ^ l . 00 xs(s,ti,m) converges to 
the same value for each t\ > si (though the point of convergence may itself 
depend on the choice of t±). 

To make this property easier to work with, we introduce some terminology. 
We say that a sequence (s n , . . . , sq) is convergent from m in pit for every i £ 
[0, to], s*[ ni i+i] € lf + i and Sj > V^^sLj+ii). The purpose of the realization 
property is to ensure that whenever S[„ ;m +i] € Ifn+n there is some sequence 
S[ n ,o] which is convergent from to in p. Coherence then states that whenever 

(s[n,m+i])*im,0]) and (*[n,m+i])*[ m , ]) are both convergent from to and x p 
is defined on both, x p has the same value on both. Therefore whenever 
S[n,m+i\ £ ^m+i' we define X*(*[n,m+i]) to be this uniquely defined value. 

Note that whenever s*[ nj o] is convergent from to, in p, S[„ )0 ] is a lso convergent 
from every m' < m, and so Xp(«[n,m+i]) = Xp(s[n,m'+i])- 

For any i with < i < n, we say g p if q ■< p and for all j > i, I? = I 9 
(and therefore Vj = V 9 ). (q ^ n p is simply q ^ p.) When q ^ p we write 

(/ ti p f° r the condition with x 9 ^ p = X 9 an d /|^ p = I 9 if j < z and /|^ p = /J 
if j > i. It is easy to check that q \ j p is a condition and q p <i p. 

If 5, r ^ p, q -<i p and r fj p = p, we define q U r to be the condition with 

x qUr = x ^ jjUr = q {{ . < . ^Ur = jr if ^ < ^ Note th&t g y r need 

not be a condition itself: for instance, when i = 0, r could include some 
new element (. . . , s) in I\ with V{(. . . , s) = v, while x 9 could be newly 
defined on (. . . , s, v + 1) with a different value from x p {- ■ ■ i s i v )- However 
the realization property sharply limits how r could expand and still satisfy 
r fi+i V = P-, so we have the following: 

Lemma 3.5. If ' q<%p and r p = p then qUr is a condition. 

Proof. We need only check the coherence property of qUr. Suppose (sj n)m +ii , ti 
and (s[ n ,m+i]> *| m o]) are both convergent from m < n and x 9 is defined on 
both. If to < % then since the property of being convergent from m depends 
only on /J Ur , Vj° r for j < m + 1, both sequences were convergent from to 
in g, and therefore by the coherence of q, x 9Ur = X 9 takes the same value 
on both. 

So consider the case where m > i. Then since (s[ n , m +i], t[ m ,o]) is con- 
vergent from to, (s[n,m+i]j *[m,o]) must also be convergent from i < m, and 
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(s[n,m+i]>*[m,i+i]) must have already belonged to lf +1 , and so 

X*( s [n,m+1]) = X*( s [n,m+1]) *[m,i+l]) = X*( s [n,m+1]) *[m,i+l])- 

But also X*(s[n,m+i],*im,i+i]) = xS(s[n,m+i], *[m,i+i])> so in particular x 9 (s[n,m+i], *[m,0]) = 
X r *{s[n,m+1])- 

By a similar argument, X 9 (s[n,m+i]>*[ m , ]) = X*(s[n,m+i])) so we have 
X 9 (s*[n, m +1], V,0]) = X 9 (s[n,m+l]»*[ m ,0]) 

as desired. □ 
We define u p to be a {0, l}-valued partial function in M such that: 

• xP - 

• If S[n,i] e then for any s > ^ p (s*[n,o]) = X*(s*[n,i])- 
Clearly if q ^ p then u p Q u q . 

We define when a condition forces a formula. We again consider formulas 
from the language C(G), which extends C? by constants for all elements of 
9Jt and a fresh set constant G. It will suffice to only consider formulas in 
prenex form. 

• If (ft is Ao, p lh (j){G) if whenever xs t dom(V p ) = z^ p , 0(<S') holds, 

• p lh if Vg ^ p 3r ^ g 3fc r lh 0(fc), 

• p lh Vx<fi(x) if Vfc p lh </>(&;). 

When (ft is in prenex form, we will abuse notation and write for the 
prenex form of the negation. 

It is easy to see that when (ft is Ao, the set of p such that p h (ft is Ai. 
We need to extend this so that the set of p forcing S m or II m sentences, for 
m < n, is defined internally. 

Lemma 3.6. If q<p and p lh (ft then q lh (ft. 

Proof. By induction on the complexity of (ft. If (ft is Ao, this is immediate 
from the definition. If (ft is II m+ i, this follows directly from the inductive 
hypothesis. If (ft is a E m +i formula 3xtft(x), for any q' ^ q, also q' ^ p, so 
there is an r ^ q' and a such that r lh ^(fc), as needed. □ 

Lemma 3.7. If p IK (ft then there is a q <p such that q II — «f>. 

Proof By induction on (ft. This is immediate when (ft is Ao- If p IK 3xip(x) 
then there is a q ■< p such that for every k and every r ^ q, r IK ^(A;). 
Therefore by the inductive hypothesis, g II — i^(fe) for every k, and therefore 
q lh Vm-i^(fc), as desired. 

If p 1/ Vxip(x) then there is a A; such that p 1/ ift(k), and so by the 

inductive hypothesis, there must be some q ■< p such that q II 'ift(k), so 

q\\-3x^ift(k). □ 

Lemma 3.8. Suppose m < n, q <p and q lh (ft where (ft is a £ m +i formula. 
Then there is a q' -< m p so that q' lh (ft. 
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Proof. By induction on m. Suppose m = and q lh 3x(p(x); we may fix an 
r -< q and a A; so that r lh 4>{k). Since forcing a Ao formula depends on 
boundedly many values of v r ', we may find a q' p by taking \ q to agree 
with u r on these values, and therefore q' lh ^(fc), so q' lh 3x0(x). 

For m > 0, suppose q lh 3xVy<p(x,y) where <f> IS £1 ^ifyi 1 formula. We 

may fix ctn t ^ q ctiid 3, h so that t II - ^y(j){h^y). Consid.Gr v \m 

p; if 

r \ p lh Vycf)(k,y) then we are done since (r \ m p) < m p. Otherwise, by the 
previous lemma, there must be some r' ^ (r \ m p) such that r' lh 3y—>^>(k, y), 
and by the inductive hypothesis, some such q' ^ m _i (r fm £>)■ 

Let p' = r \ m p. Then q' ^ m _i p' and r \ p' = p' , so Lemma 13.51 applies, 
and q' U r is a condition. Since g'Ur ^ (/, we have q' L) r lh 3y—«f)(k,y). 
Since g'Ur ^ r, we have 5'Ur lh \/y<f)(k,y). This is a contradiction, so 
r \ m P II- Vy(p(k,y). □ 



This implies that when q ^ p and g lh where is a n m formula, there 
is a q' < m p so that q' lh 0. 

Let Eto^x) be a S m formula with ui <C n. By Lemma 13. 7( p lh 3xip{x~) iff 
there is no q < p such that q lh \/x-np(x), and this in turn is equivalent to 
there being no q' -< m p such that q' lh Vx-np(x). Note that quantification 
over q' < m p is internal, so by induction on the complexity of formulas, when 
m < n and 3x<f>(x) is a E m formula, the set of p such that p lh 3xc/>(x) and 
the set of p such that p lh Vx3y(f)(x, y) are both n m+ i. 

Lemma 3.9 (JS n ). For any p and any S n formula 3y(j)(x,y), there is a 
q ^n-i P such that one of the following holds: 

• q\\-VxVy->(f>(x,y), 

• There are a c and a k such that q lh 0(c, k) and for every d < c, 
q lh \/y^(j)(c',y). 

Proof. Let p and (ft be given. Consider the set of c such that there exists a 
Q ^n-i V an d a fc with q lh 0(c, fc). 

Suppose there is no such c. If q < p and q lh 0(c, fc) then, since (ft(c, k) is 
a II n _i formula, there would be some q' ^ n _i p such that q' lh 0(c, fc). So 
there is no such q < p, and therefore p II — ><ft(c, k). Since this holds for every 
c, k, p lh VcVk-«j>(c, k). 

Suppose there is such a c. Since the set of q such that q lh (ft(c, &) is given 
by a n n _i formula, the existence of such & q,k is a S n formula, so there 
must be a least c such that there exist such a q, k. We choose some q and 
some so that q lh $>(c, k), and so (7 lh 3x(f>(c, k). Suppose q' < q and there 
is a d < c such that q' lh 3y<fi(c',y); then there would be an r < q' and 
a such that r lh <ft(d,k), contradicting the leastness of c. So there is no 
such q', and so for every d < c, each q' < q must have q' \f 3y<p(d,y), so 
q\\-Vy^(j)(d,y). □ 
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Proof of Theorem \3.3[ Again, by Theorem l3.2| it suffices to show that there 
is an X such that lim n X = S and for every S n formula 4>(x,G) with pa- 
rameters from SDt, the least number principle holds for {x \ <p(x,X)}. We 
construct an infinite sequence pi y p% y • • ■ such that: 

• If 3xcf>{ y x) is a S m formula with m ^ n and p% lh 3j;0(x) then there 
is a j and a k such that lh 0(fc), 

• For every X] n formula 3y(p( K x, y), either there is a j withp^ lh VxVy !(/>(x, 
or a c,k,i with pj lh 0(c, fc), 

• For each r < n, |J i I?* = |M|, 

• U,:^n = 1^1 and wnen s n G then x P *{sn) = Xs(s n ). 

Each of these families consists of countably many requirements, so it suffices 
to show that given any p and any individual requirement, there is a q < p 
satisfying the additional requirement. In order to avoid conflict with the 
fourth part, when satisfying the first three families, we must have q d^n-l P- 

For the first family, observe that if p lh 3xcj){x) then there must, by defi- 
nition, be a q ^ p and a k with q lh 4>(k), and since </>(fc) is a II m _i formula 
with m — 1 < n, we may take q ^ n -i P- The existence of q P satis- 

fying the second family is given by the preceding lemma. The existence of 
q ^ n _i p satisfying the third family is trivial 

For the final condition, we may take any s n In and define q by In = 
In U {s n }, adding realizations larger than any elements where x p 1S defined, 
and setting x g ° n the resulting sequence equal to xw($n)- 

Suppose we have such a sequence. We take S = {k \ 3i v Pi (k) = 1}. We 
claim that if <p(G) is a S„ or H n formula and there is an i with pi lh 4>(G) the 
(j)(S) holds. We show this by induction on (ft; when (ft is Ao, this is immediate 
from the definition. Suppose pi lh 3x(ft(x, G); by the construction, there is a 
j > i and a k so that pj lh (ft(k, G), and so by IH, cft(k, S), and so 3x(ft(x, S). 
If pi lh \/xcft{x, G) then for each k, pi lh cft(k, G), so by IH, (ft(k, S) holds, and 
therefore \/xcft{x, S) holds. 

Together with the second requirement, this implies that the least number 
principle holds for {x \ (ft(x, S)} whenever (ft is a S n formula. 

It remains to show that lim n X = S. We show by induction on r that 
lim r X exists and for each s*[ nir i, Xhm r x (s[n,r]) = X^ l {s[n,r]) f° r some (and 
therefore every) i large enough that s*[ n r ] S I? 1 ■ When r = 1, whenever 
sLu € If 1 , we have ^ Pi (sL ]) = X*' '{s[n,i\) f° r coboundedly many values of 
so- Since for any S[ n ,\] there is some pi with sr n)1 i 6 if% the claim follows 
immediately. 

Consider some r > 1 and some sr n)r i £ i? 1 ; for every s r _i > ^'(sLj), 
there must be some j such that S[ n , r =i] S J r £. l3 and therefore by the inductive 
hypothesis, X lini r-i x (s[„ jr -i]) exists and is equal to x* J (s[ n ,r-l]) = X* ! (s [n ,r])- 
Since this holds for every sr„ jr i, and, given some st^h, for coboundedly many 
Sf-i, the claim follows. 

In particular, it follows from the fourth requirement that lim n X exists 
and is equal to S. □ 
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4. Conservation over Fragments of Arithmetic 

The results in the previous section make it easy to prove a number of 
results about n}-MAX(RCA + J£ n ). 

Definition 4.1. I C M is a cut if / is an initial segment of M closed under 
successor. 

Theorem 4.2. The set of Godel numbers of formulas in Il}-MAX(RCAo + 

n ) is IT2 complete. 

Proof It is easy to see that n}-MAX(RCA +/X n ) is U 2 : a G n}-MAX(RCA + 
JS n ) exactly if a is n?, and every for proof of a IT} formula in RC Ao+/S n +cr, 
there is a proof of that formula in RCAo + 

On the other hand, for any II2 sentence Vx3y(fi(x, y) with <fi a Ao formula, 
consider the £} sentence <£: 

There exists a set X such that lim n A is a cut and for any 
x G lim™ A, there is a y G lim™ X such that y) holds. 

If N 1= \/x3y<j)(x, y) then whenever 9Jt is a countable model of RCAo+/S„, 
we may apply Theorem l3.3l to obtain a set extension 9K' such that N = lim" - S 
for some S G A4'. Therefore 9Jt' 1= <!>. Since this holds for any countable 
model, by Lemma 12.31 it follows that RCAo + I^n + ^ is a 11} conservative 
extension of RCAo + I^n- 

On the other hand, if N \f \/x3y(j)(x,y), there must be some n such that 
N 1= Vy-i0(n, y). However RCAo + I^n + ^ implies 3y4>(n,y); since N 1= 
RCAo + I^ni it follows that RCAo + I^n V 3y^(n, y), so 3ycp(n,y) is an 
arithmetic formula implied by RCAo+/S n +$ but not by RCAo+/S„. □ 

Remark 4.3. 

• This immediately answers Question 3.5 of [9(: n}-MAX(RCAo) is 
not computably axiomatizable. 

• If T is any theory which is not 11} conservative over RCAo + I^n 
then we may take any LT} formula 9 with T h 9 but RCAo + /S n V 9, 
and we could carry out the argument above using the formulas $ V 9 
(one can manipulate the quantifiers to get this into a strict Ilr, form). 
So the situation is also not simplified in the restriction to sentences 
provable in T. This answers Question 3.2 of [9(|. 

• In particular, if 9 is a true II} formula not implied by RCAo + I^m 
the argument could be carried out using sentences $ V 9, which are 
true. 

A more complicated use of this method, together with an idea from [2], 
can answer Question 3.3 of 0]: 

Theorem 4.4. There is a II2 theory T which is a LT} conservative extension 
of RCAo + I^n and a nonstandard model Wl which is not an to -submodel 
of any model of T. 
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Proof. Recall that a model M is recursively saturated if whenever ( \<j)i (x, y)~\ } 
is a computable sequence of Godel numbers of (arithmetic) formulas and 
a G MM is a tuple such that, for each n, M N 3x\/i < ruf>i{x, a), then there 
is an m € \M\ such that ViM 1= 4>i(m, a). (It does not change the notion if 
we replace recursive with Si, an idea which will help us below.) 

Consider the formula Sat(fc, X) which states that X codes the satisfi- 
ability relation for formulas with Godel number below k. That is, for 
< k, {\(fi],a) G X iff the usual Tarski conditions hold (if eft is atomic 
then only when 4>(a) holds, if cp is Bxtfj then only if there is some m such 
that ( , aT^m) G X, and so on). This is an arithmetic formula. Write 
X \k = {(\cP],a)eX\\4>]<k}. 

We will encode a cut, Wo, and a satisfaction relation Wi which satisfies 
Sat(fc, Wi \ k) for every k G W$. We then wish to consider types relative to 
this cut: that is, we take an index e (not necessarily in Wo) and view it as 
defining a type, namely those k G Wq such that, for some m, {e}(m) = k. 
We can think think of a type as being "satisfiable" below some m if there 
is an x such that whenever m' < m and {e}(m') exists and belongs to Wo, 
{{e}(m'), x) G W\. (Actually, we fix a tuple of parameters a in addition to 
the function {e}.) Recursive saturation is related to having an induction 
property for this notion: either there is an m so that the type is satisfiable 
below m but not m + 1, or the type is fully satisfiable — there is a single x 
with ({e}(m), x) G W\ whenever {e}(m) exists and belongs to Wo- 

More precisely, we consider the sentence given by: 

There is a set S = (So,Si) such that, taking Wo = fim" So 
and Wi =lim n Sr. 

(1) Wo is a cut, 

(2) For k G W , Sat(k,Wi \ k), 

(3) Let a tuple a and an element e G Wo be given; then 
either: 

• There is an m G Wq and an x such that for every 
m' < m such that {e}(m') converges to a value in 
Wo, ({e}(m'), (x, a)) G W\, but there is no x' such 
that for every m' < m such that {e}(m') converges 
to a value in Wo, ({e}(m), (x',a)) G W\, or 

• There is an x such that for every m G Wo such that 
{e}(m) converges to a value in Web ({e}(m), (x, a)} G 
Wi. 

Let WI be recursively saturated; then if Wo = N and W\ is the actual 
satisfiability relation for M, the pair (So, Si) will satisfy <£. Therefore by 
Theorem 13.31 $R is an ^-submodel of a model of 

Conversely, suppose 9Jt N <E> and let (\cpi(x, y)~\) = {{e}(i)) be an actual 
computable sequence of formulas (that is, e G N and each {e}(i) exists and 
belongs to N) and let a be such that for each n G N, M t= 3x\/i < n(f>i(x, a). 
The definition of satisfiability is unique for actual formulas, and since {e}(i) 
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converges to an element in N C Wq for all i G N, for each n G N there is an 
x so that for every i < n, ({e}(i), (x, a)} G W\. Consider the two cases given 
by condition ([3]); in the first case, let x and m be given so that for every 
m' < m such that {e}(m') converges, ({e}(m'),(x,a)) G W\. We cannot 
have m G N since the sequence is finitely satisfiable, so m > N. But then 
({e}(n), (x,a)) G W± for all ra. 

In the second case, it is immediate that x is the desired witness. □ 

This method could also be used to produce a sentence $' so that 9Jt 
can be expanded to satisfy <£' iff (M, Si, ... , S n ) is recursively saturated for 
any choice of finitely many Si , . . . , S n G A4. 

5. Conservation over ACA 

The work in this section is joint with Peter Cholak. 

The method we used to show that Il^-MAX(RCAo + is II2 complete 
depended on the fact that in theories like RCAo+/S n there is a "mismatch" 
between the restrictions on possible sets placed by the axioms and our ability 
to describe sets using arithmetic formulas — that is, since the axioms all have 
low quantifier complexity, we were able to encode arbitrary sets by making 
sure they could only be decoded using formulas more complicated than the 
axioms. Over ACAo, we need a different technique. 

The following argument from [l[ provides inspiration: 

Theorem 5.1. There is a H\ sentence false in the standard model which is 
H\ conservative over ACAo- 

Proof. A sentence o~, obtained using the fixed point lemma, is: 
3<f>3X [4>{X) A ACA + 3X(j)(X) h -.a)] . 

That is, a says: 

My negation is provable in ACAo from a true T,\ sentence. 

(We use here the fact that in ACAo there is a T,\ truth predicate for T,\ 
sentences.) 

This sentence is clearly false in the standard model, since if it were true, 
its negation would actually be provable, leading to a contradiction. 

To see that a is conservative, suppose ACAo + a h *iX-i<j)(X). Then 

ACA + 3Xcp(X) I >a. But, working in ACA + 3X(p(X), we see that 

3Xcp(X) is true and that ACA + 3Xcp(X) h -.<r, so ACA + 3X(p(X) h a 
as well. This is a contradiction, so ACAo l~ ^X^(j)(X), as desired. □ 

Theorem 5.2. The set of Godel numbers of formulas in n}-MAX(ACAo) 

is TI2 complete. 

Proof. We write T \- p <j> for the statement that p is the Godel number of a 
proof of from the set of formulas T. 
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Given a quantifier free formula ip, consider the following sentence cy, 
obtained using the fixed point lemma: 

3<J)3X [4>{X) A Vy(3ziP(y, z) V 3p < y ACA + 3X<P{X) h p ^)] . 

This sentence says: 

Either \/y3zip(y, z) or the first counterexample gives a bound 
for a proof of my negation from ACAo plus a true sen- 
tence. 

Suppose N 1= Vy3zip(y, z) and that 

ACA + oy, h VX^(f)(X). 

Then also 

ACA + 3X<P(X) h -.<ty. 

In particular, there is a natural number p which is the Godel number of this 
proof, and so, together with the finitely many witnesses that when y < p 
there is a z with ip(y, z), we obtain a finite number witnessing that 

Vy(3z^(y, z)v3p< yACA + 3X<P{X) h p -.^) 

and therefore ACAo proves this. But then ACAo + 3X<p(X) h a^. Since 
ACA + 3X<j)(X) h o$ A -icr,/,, we have 

ACA hVX^(X), 

showing that ACAo + is n} conservative over ACAo- 

On the other hand, suppose N 1= 3yiz^ip{y, z). Fix the least n such that 
N 1= Vz-n/>(n, z). If there is no p < n such that ACAo + 3X(/)(X) \- p -iov, 
for some <f> then ACAo + o-^\- 3zV( n > z )i an arithmetic statement which is 
false, and so not a consequence of ACAo- Suppose there is such a p; there 
are finitely many pi,...,Pk below n such that for each i there is a <j>i so that 
AC Ao + 3X <pi(X) \~ Pi —i(t^. Therefore ACAo + o-^ + Vz^ipfa, z) must prove 
3X<pi (X) V • • • 3X(f) k (X). It follows that ACA + o> + Mz^(n, z) h -.o^. 
This is a contradiction, so again ACAo + \~ 3ztp(n, z). □ 

6. Conclusion 

We have not considered other fragments of ACAo which have been stud- 
ied in the literature. The most important other family of fragments are 
those given by the bounded collection scheme, BH n . 

Question 6.1. Is n{-MAX(RCA + BY, n ) U 2 complete? 

The same question could be asked of other natural families of fragments 
of arithmetic, so we also wonder what the limits to this result are. 

Question 6.2. Is there a computably axiomatized fragment T of Peano 
arithmetic so that IlJ-MAX(RCAo + T) is computable? Is there such a 
fragment with IlJ-MAX(RCAo +T) computably enumerable? Is there such 
a T where the axioms have bounded quantifier complexity? 
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Over ACAo there is a known theory of LT3, II J, conservative extensions 
(see [1] ) , some of it developed using techniques which inspired ideas in this 
paper (especially Analogously to nj-MAX, there are maximal n n _ ) _ 1 , 

11^ conservative theories for all n > 1, and these theories are, by the same 
argument as for n = 1, II2. 

Question 6.3. Is the maximal II* , 1? 11* conservative extension of T II2 
complete, for n > 2 and T either RC Ao + /S m or ACAo ? 
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